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(54) A test efficient method of classifying image quality of an optical sensor using three 
categories of pixels 



pixel class, for example, a dark pixel class, a dim pixel 
class, and an acceptable pixel class. An image filter 
(106) processes the sensor pixel image (105), filtering 
out all pixels that fall within the acceptable pixel class, to 
generate a defective pixel map (108). The defective 
pixel map (108) includes those pixels which have a 
quantized intensity level that falls within the first and/or 
second pixel class but not the third pixel class. 
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(57) A multi-threshold optical binning method for 
classifying the image quality of an optical sensor (104) 
is presented. In accordance with the invention, a sensor 
tester (102) causes a sensor pixel image (105) to be 
generated by a sensor under test (104). The sensor 
pixel image (105) is comprised of a plurality of pixels, 
each represented by an associated quantized intensity 
level. The quantized intensity level of a pixel may fall into 
one of a first pixel class, a second pixel class, or a third 
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Description 

Field of the Invention 

[0001] The present invention pertains generally to 
image processing, and more particularly to a method 
and apparatus for classifying the image quality of an 
optical sensor using additional image characteristic 
thresholds. 

Background "f the Invention 

[0002] A digital image is an array of pixels, each of 
which is digitally quantized into an intensity level. Digital 
images are known to require a significant amount of 
storage area. For example, in a black-and-white image, 
a digital image comprising an array of 512 x 512 pixels, 
each quantized into a gray level represented by 8 bits, 
requires 0.25 megabytes of storage. An increase in the 
sampling rate (i.e., number of pixels in the array) and/or 
an increase in the quantization level (i.e., the number of 
bits, or gray levels, that represent the image) further 
increases the amount of required storage for an image. 
The use of color, which is typically formed by varying the 
intensity levels of a combination of the three primary 
colors, red (R), green (G), and blue (B). and collectively 
known in the industry as the RGB components, also 
increases the amount of storage required. Accordingly, 
due to the large amount of data generated for a single 
image, the use of high-resolution digital images in com- 
puter applications was generally, until recently, some- 
what limited. 

[0003] With the leaps in amount of processing 
power and data storage capability in modern computer 
systems over the past few years, along with the lower 
costs and therefore increased availability to more end- 
users, the use of higher-resolution (represented by a 
larger number of pixels), higher-quality (represented by 
increased number quantization levels), and even color, 
digital images has become more and more viable. 
[0004] At the same time, leaps in modern digital tel- 
ecommunication system technology, including improve- 
ments in network bandwidth and network switching 
hardware for both the Internet and digital cellular sys- 
tems, has increased both business and personal com- 
munication over networked computers. This has 
increased the demand for, and use of, digital images as 
a part of modem remote communication. 
[0005] With the increased use of digital images in 
computer applications and communication, increased 
attention has been focused on the quality of the image. 
Digital images may be generated in a number of ways, 
including by way of microdensitometers, flying spot 
scanners, image dissectors, vidicon cameras, and pho- 
tosensitive solid-state array sensors. 
[0006] Microdensitometers and flying spot scan- 
ners receive input in the form of analog transparencies 
such as a film negative or a photograph, and digitize 



them into a digital pixel file. With image dissectors and 
vidicon cameras, an image is focused on a photosensi- 
tive tube whose response is proportional to the incident 
light pattern. The image dissector employs an electro- 

5 magnet which is used to deflect the entire beam past a 
pinhole located in the back of the dissector tube. The 
pinhole lets through only a small cross-section of the 
beam which is quantized into a single pixel. The electro- 
magnet must move the beam for each discrete pixel 

10 desired. With the vidicon camera, the image focused on 
the tube surface produces a pattern of varying conduc- 
tivity that matches the distribution of intensity in the opti- 
cal image. The conductivity pattern is scanned by an 
electron beam which converts into a signal proportional 

15 to the intensity pattern of the input image. This signal is 
then quantized to produce the digital image. 
[0007] By far the most common method of generat- 
ing a digital image is via solid-state arrays. Sofid-state 
array sensors comprise an array of discrete silicon 

20 imaging elements called "photosrtes", and are generally 
organized into one of two geometrical arrangements. 
The first, known as a "line-scan sensor, comprises a 
row of photosites and produces a two-dimensional 
image by relative motion between the scene and the 

25 detector. The second, known as an "area sensor" is a 
two-dimensional matrix of photosites and captures the 
image in a similar manner as a vidicon camera. 
[0008] In the manufacturer of digital image sensors, 
the quality of the sensor is often categorized into differ- 

30 ent levels of classifications that are based on the image 
quality. For example, in solid-state array sensors, it is 
not uncommon to incur a defect in one or more of the 
photosites composing it, and a determination must be 
made as to whether the sensor should be kept, and or 

35 discarded. The classifications reflect the quality of the 
image produced by the array sensor, and are used to 
indicate the appropriate applications for which a partic- 
ular array sensor is suited. 

[0009] FIG. 1 is a two-dimensional pixel diagram 

40 illustrating a blank image 10 that contains several com- 
mon types of defects. Defective pixels are darkened in 
this aiustration. One type of defect is known as "point" 
defect. A point defect is a defect in a single pixel, such 
as pixels 12 and 20, with no defects in all of its N-near- 

45 est neighbor pixels. In a two-dimensional array, a pixel p 
at coordinates (x, y) has four horizontal and vertical 
neigrtoors located a unit distance from p at (x+1 , y, (x-1 , 
y). (x. y+ 1 ). and (x, y-1), and four diagonal neighbors 
located a unit distance from p at (x+1 , y+1), (x+1 , y-1). 

so (x-1, y+1), and (x-1, y-1). As will be appreciated by 
those skilled in the art, pixels located along the borders 
of the image do not have a full set of neighbors since the 
position of some of their calculated neighbors reside 
outside the image. 

55 [001 0] A common method of specifying image qual- 
ity is based on setting a single lower (dark) and/or upper 
(bright) threshold limit relative to the mean for dark 
and/or bright pixel intensity. FIG. 2 is a graph illustrating 
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a prior art single-threshold defective pixel system. In 
this system, pixels with intensities below the dark and/or 
above the bright threshold limit are flagged as defects. 
FIG. 3(a) is a perspective view, and FIG. 3(b) is a side 
view, of the pixel image of FIG. 1 , where the quantized 5 
intensity level is plotted along the z-axis. 
[0011] Image quality is categorized into classifica- 
tions based on the size of the largest allowed cluster 
and the number of single pixel and cluster defects. Typ- 
ically a point defect, illustrated at 12 and 20 in FIGS. 1 10 
and 3, is imperceptible by the naked eye. Accordingly, a 
sensor with one or a few point pixels, while it does con- 
tain defects, may actually be of high enough quality for 
many applications and therefore could be used for some 
applications. 15 
[0012] Another type of defect is known as a "dus- 
ter" defect. A cluster defect is a grouping of physically 
adjacent point defects, such as those collective group- 
ing of pixels shown at 14. 

[0013] A disadvantage of the single-threshold 20 
method is that it may fail to detect local non-uniformity or 
"area defects" that are easily observed by the human 
eye. For example, a portion of the collective pixels at 1 6 
and 18 are above the dark threshold level, so a cluster 
defect is not detected using the single-threshold 25 
method. However, a portion of the neighboring pixels 
are sufficiently dim that when viewed collectively by the 
human eye. an area defect is easily observable. Setting 
a tighter dark (bright) threshold level aids in the area 
defect detection and cluster description, but this results so 
in a larger number of defects and a definition of a single 
pixel defect that is not perceived as a defect under nor- 
mal viewing conditions. 

[0014] One method for basing classifications on 
human perception is by detecting local non-uniformity 35 
by computing near-neighbor density averages over 
small subsets of the total array and setting limits on the 
local average However, computing local averages 
requires the collection, and manipulation, of large 
amounts of data, which results in lengthy testing time 40 
and high testing costs. 

[0015] Accordingly, a need exists for an improved 
image classification method that is based on human 
perception without the associated high test costs. 

45 

Summary of the Inyeptipn 

[001 6] The present invention is a novel method and 
apparatus for classifying the image quality of an image 
generated by an optical sensor under test In accord- so 
ance with the invention, a sensor tester causes a sensor 
pixel image to be generated by a sensor under test The 
sensor pixel image is comprised of a plurality of pixels, 
each represented by an associated quantized intensity 
level. The quantized intensity level of a pixel may fall into 55 
one of a first pixel class, a second pixel class, or a third 
pixel class, for example, a dark pixel class, a dim pixel 
class, and an acceptable pixel class. An image filter 



processes the sensor pixel image, filtering out all pixels 
that fall within the acceptable pixel class, to generate a 
defective pixel map. The defective pixel map includes 
those pixels which have a quantized intensity level that 
falls within the first and/or second pixel class but not the 
third pixel class. 

[0017] The invention allows a binning processor to 
process only those pixels from the sensor pixel image 
that are either definitely defective (i.e., they lie within the 
first pixel class) or that are suspect (i.e., they fall within 
the second pixel class). Using local average density cal- 
culations on the filtered pixels only, a binning processor 
can quickly classify the image quality of the sensor 
under test, as well as identify area defects. 

Brief Description of the Drawing 

[0018] The invention will be better understood from 
a reading of the following detailed description taken in 
conjunction with the drawing in which like reference 
designators are used to designate like elements, and in 
which: 

FIG. 1 is a two-dimensional pixel diagram illustrat- 
ing a blank image 10 that contains several common 
types of defects; 

FIG. 2 is a graph illustrating a prior art single- 
threshold defective pixel system; 
FIG. 3(a) is a perspective view of the pixel image of 
FIG. 1; 

FIG. 3(b) is a side view of the pixel image of FIGS. 
1 and 3(a); 

FIG. 4 is an optical sensor testing system 100 in 

accordance with the invention; 

FIG. 5 is a graph illustrating the two-threshold 

defective pixel system of the invention; 

FIG. 6 is a block diagram of one embodiment of an 

image filter in accordance with the invention; 

FIG. 7(a) is a perspective view of the pixel image of 

FIG. 1, illustrating the advantages obtained using 

the two-threshold method of the invention; 

FIG. 7(b) is a side view of the pixel image of FIGS. 

1 and 7(a); and 

FIG. 8 is a flowchart of one embodiment of a 
method in accordance with the invention. 

Detailed Description 

[0019] A novel method and apparatus for classify- 
ing the image quality of an optical sensor is described in 
detail hereinafter. While the invention is described in the 
context of an optical sensor, those skilled in the art will 
appreciate that the method and apparatus of the inven- 
tion may be applied in any digital image binning applica- 
tion. 

[0020] turning now to FIG. 4, there is presented an 
optical sensor testing system 100. System 100 includes 
a sensor tester 102 which tests an optical sensor under 
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test 1 04. Sensor tester 102 causes a sensor pixel image 
1 05 to be generated from sensor under test 104. In one 
embodiment, standard imaging concfitions used for opti- 
cal tests employ a tungsten halogen lamp (not shown) 
to uniformly illuminate the photosite array of sensor 
under test 104. Sensor pixel image 105 comprises a 
quantized intensity level for all of the pixels, or a subset 
thereof, in the image generated by the sensor under test 
104. 

[0021] An image filter 106 processes each pixel of 
sensor pixel image 105. comparing the quantized inten- 
sity level of the pixel to the requirements of a dim 
(brighter) pixel class and a dark (brightest) pixel class 
as illustrated in FIG. 5. Those pixels in sensor pixel 
image 105 that meet the requirements of a dim 
(brighter) pixel class and/or a dark (brightest) pixel class 
are added to a defective pixel map 108 associated with 
the sensor under test 104. Image filter 106 generally 
comprises a dim (brighter) pixel class comparator 166, 
shown in FIG. 6, and a dark (brightest) pixel class com- 
parator 168 that compares the quantized intensity level 
of each pixel to be processed to the class parameters 
(i.e., the delimiting intensity threshold levels) to deter- 
mine whether a given pixel falls within its respective 
class. Image filter 106 may be implemented as a soft- 
ware process or in hardware using a set of dim 
(brighter) and dark (brightest) comparator circuits. A 
defective pixel map generator 1 70 accumulates an entry 
for each pixel that falls within either the dark (brighter) or 
dim (brightest) pixel class. In the preferred embodiment 
each entry in defective pixel map 108 includes the coor- 
dinates and dim/dark (brighterybrightest) classification 
of its associated pixel. When the entire sensor pixel 
image 105 has been processed by image filter 106. 
defective pixel map 108 associated with the particular 
sensor under test 1 04 contains a subset of the entire set 
of image pixels of sensor pixel image 105 that fall into 
one of the dim/dark (brightertorightest) classifications. 
In a typical manufacturing process, image filter 106 thus 
operates to filter out all "good" pixels from sensor pixel 
image 105 to generate defective pixel map 108, thereby 
eliminating most (typically 99%) of the pixels that bin- 
ning processor 110 must process. Furthermore, 
because even a relatively small array, such as video 
graphics array (VGA), represents a very large (307,200) 
pixel count, the time required to upload the sparse pixel 
information from sensor tester 102 to a remotely located 
binning processor 110 is greatly reduced. 
[0022] FIG 7(a) is a perspective view, and FIG. 7(b) 
is a side view, of the pixel image of FIG. 1. illustrating 
the different manufacturing yield resufts that would be 
obtained using the two-threshold method of the inven- 
tion. In this example, the dark threshold level can be 
relaxed such that pixel 20, which is of an intensity level 
that would be imperceptible to the human eye, is not 
flagged as a defect, yet pixel 12, which is sufficiently 
dark that it could be perceived, is captured as a defect. 
In addition, because the invention calls for a new dim 



pixel class, the detection of area defects becomes much 
easier for a binning processor 110. A number of adja- 
cent or near-neighbor dim pixels may signify an area 
defect that is perceptible to the human eye, that other- 
5 wise would not be detected using the prior art single- 
threshold method. 

[0023] Neighbor distance defines when point 
defects are combined into a cluster defect. By using a 
large neighbor distance a sparse set of dim pixels, 

10 which may not be detected under a single-threshold 
model, is combined into a cluster. The severity of a clus- 
ter is evaluated in terms of its darkness and its size. An 
area defect occurs when the average intensity is 
exceeded for large clusters. For small cluster sizes, 

15 darkness is described in terms of the number of dark 
and dim pixels. 

[0024] Binning processor 110 processes defective 
pixel map 108 to determine which image classification 
the sensor under test 104 falls into. Binning processor 

20 110 may be implemented in hardware or software, and 
may reside within, or remote from, sensor tester 102. 
Image classification is manufacturer specific, and the 
gradings and criteria used to determine each grade 
level typically vary from manufacturer to manufacturer. 

25 However, with the detection of different intensity level 
classifications, such as the dim (brighter) and dark 
(brightest) classifications, detected in the present inven- 
tion, binning processor 110 may be implemented with 
more intelligence to classify images based on human 

30 perception. For example, binning processor 110 per- 
forms local average density calculations only on the pix- 
els contained in the defective pixel map 108 to detect 
area defects that might otherwise go undetected. Fur- 
thermore, because binning processor 110 processes 

35 only a minute subset of pixels from the full image, more 
sophisticated intelligence may be implemented yet still 
reduce the test time over prior art image classification 
techniques. 

[0025] FIG. 8 is a flowchart of one embodiment of a 

40 method performed by image filter 106. In a step 302 a 
pixel is obtained from sensor pixel image 105. The pixel 
intensity value is compared to a dim (brighter) threshold 
level, which is brighter (darker) in intensity than the dark 
(brightest) threshold level. A determination is made as 

45 to whether the pixel intensity value is at or below the dim 
(brighter) threshold level in step 306. If not. proceed to 
step 318. If it is, the pixel intensity value is compared to 
the dark (brightest) threshold level in step 308. In step 
310, a determination is made as to whether the pixel 

so intensity value is at or below the dark (brightest) thresh- 
old level. If the pixel intensity value is at or below the 
dark (brightest) threshold level, the pixel is marked as 
belonging to the "dark" pxel class in step 312. If the 
pixel intensity value is above the dark (brightest) thresh- 

55 old level, the pixel is marked as belonging to the "dim" 
pixel class in step 314. Because the pixel was classified 
as either "dark" or "dim" in respective step 312 or 314, 
the pixel is added to the defective pixel map 108 in step 
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316. If sensor pixel image 105 contains more pixels as 
yet to be processed by image filter 106, as determined 
in step 318, steps 302 through 318 are repeated. When 
all pixels in sensor pixel image 105 have been proc- 
essed, method 300 is complete. 5 
[0026] Those skilled in the art will appreciated that 
although the method 300 serially processes pixels of 
sensor pixel image 105, the pixels may, in the alterna- 
tive, be processed in parallel. Parallel processing of the 
pixel image is especially appropriate if the pixel intensity 10 
values of sensor under test 104 are available in parallel 
via multiple pins. 

[0027] As described in detail above, the present 
invention provides an efficient technique for classifying 
images according to human perception using only a 15 
sparse data set. 

Claims 

1 . An image filter for processing a sensor pixel image 20 
(105) generated by a sensor under test (104), said 
sensor pixel image (105) comprising a plurality of 
pixels, each of said plurality of pixels represented 

by an associated quantized intensity level, said 
quantized intensity level being within one of a first 25 
pixel class, a second pixel class, or a third pixel 
class, said image filter comprising: 

an image filter input which receives said plural- 
ity of pixels of said sensor pixel image (1 05); 30 

a filter (106) which determines which of said 
first pixel class, said second pixel class, or said 
third pixel class that each of said quantized 
intensity levels associated with said plurality of 35 
pixels of said sensor pixel image (105) falls 
within; and 

an image filter output which outputs an indica- 
tion of which of said plurality of pixels foils 40 
within said f irst pixel class and/a said second 
pixel class but not said third pixel class. 

2. An image filter in accordance with claim 1 , compris- 
ing: 45 

a defective pixel map generator responsive to . 
said indications from said image filter output to 
generate a defective pixel map (108), said 
defective pixel map (108) comprising a subset so 
of said plurality of pixels of said sensor pixel 
image (105) which each have a quantized 
intensity level that fells within said first pixel 
class and/or said second pixel class but not 
said third pixel class. 55 

3. An image filter in accordance with claim 2. compris- 
ing: 



a binning processor (110) which processes 
said defective pixel map (108) to determine an 
image quality classification for said sensor 
under test (104), said image quality classifica- 
tion indicating which of a plurality of quality cat- 
egories said sensor under test (104) belongs 
ta ,- . 

4. An image filter in accordance with claim 1, 2 or 3, 
comprising: 

a sensor tester (102) which causes said sensor 
pixel image (105) to be generated by said sen- 
sor under test (104). 

5- An image filter in accordance with claim 1 , 2, 3 or 4, 
wherein: said filter (106) comprises: 

a first comparator 166 for determining whether 
said quantized pixel intensity falls within said 
first pixel class; and 

a second comparator 168 for determining 
whether said quantized pixel intensity falls 
within said second pixel class. 

6. An image filter in accordance with claim 1 . 2, 3, 4 or 
5, wherein: 

said first pixel class comprises a dark pixel 
class comprising pixels below a dark threshold 
level; 

said second pixel class comprises a dim pixel 
class comprising pixels below a dim threshold 
level and above said dark threshold level. 

7. An image filter in accordance with claim 1 . 2, 3, 4 or 
5, wherein: 

said first pixel class comprises a brightest pixel 
class comprising pixels above a brightest 
threshold level; 

said second pixel class comprises a brighter 
pixel class comprising pixels above a brighter 
threshold level and below said brightest thresh- 
old level. 

a An image filter in accordance with claim 1 , 2, 3, 4 or 
5, wherein: 

said first pixel class comprises: 

a dark pixel class comprising pixels below a 

dark threshold level; and 

a brightest pixel class comprising pixels above 

a brightest threshold level; and 

said second pixel class comprises: 

a dim pixel class comprising pixels below a dim 

threshold level and above a dark threshold 
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level; and 

a brighter pixel class comprising pixels above a 
brighter threshold level and below said bright- 
est threshold level. 

5 

9. A method for classifying an image quality of an 
image generated by an optical sensor under test 
(104), comprising: 

obtaining a sensor pixel image (1 05) generated 10 
by said sensor under test (104), said sensor 
pixel image (105) comprising a plurality of pix- 
els, each of said plurality of pixels represented 
by an associated quantized intensity level, said 
quantized intensity level being within one of a is 
first pixel class, a second pixel class, or a third 
pixel class; and 

generating a defective pixel map (108), said 
defective pixel map (108) comprising a subset 
of said plurality of pixels which each have a 20 
quantized intensity level that falls within said 
first pixel class and/or said second pixel class 
but not said third pixel class. 



10. A method in accordance with claim 9, wherein: 25 



said generating step comprises: 

obtaining a quantized intensity level associated 

with an unprocessed one of said plurality of pix- 



30 



comparing said quantized intensity level to a 
set of predetermined first pixel class parame- 
ters which define said first pixel class; 
determining whether said quantized intensity 
level falls within said first pixel class; 3S 
comparing said quantized intensity level to a 
set of predetermined second pixel class 
parameters which define said second pixel 



determining whether said quantized intensity 40 
level falls within said second pixel class; 
adding said unprocessed one of said plurality 
of pixels to said defective pixel map (108) if said 
quantized intensity level associated with said 
unprocessed one of said plurality of pixels falls 45 
within either said first pixel class or said second 
pixel class; and 

repeating said obtaining step through said add- 
ing step if said plurality of pixels comprises one 
or more unprocessed pixels. so 
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